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The purpose of this memorandum is to acquaint personnel who have limited 
background in communication theory, but deal with certain aspects of communi- 
cations work, with some of the more common vernacular in the area of com- 
munication technology. The concentration here will be on signal -to -noise ratios, 
bit errors, quantization, and the like. 


Probably the best place to start is with a definition of signal -to -noise ratio. 
As defined by Shannon in his classical theorem on channel capacity, it is the ratio 
of the variance of the signal to the variance of the noise; that is, if the signal 
variable is x and the noise variable y, with z = x + y, then 
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where we have denoted an ensemble average by E[ * ] . This definition also has 
the advantage of not being affected by any large dc biases which might add to the 
signal power but not to the signal content. 


Another definition which has common use is 
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which stems from the Tchebycheff inequality, 
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When we set 

c = pE[ z] , 

we have 
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If the noise has a constant and known mean, E[ z] = E[ z] j „ = q + C. This defi- 
nition is useful when the sample mean is the primary statistic of interest. This 
holds true in the areas of detection theory, where the signal -to -noise ratio at the 
output of a matched filter is defined in this manner, and in the field of photo 
detection devices where the signal -to -noise ratio of the current flow is defined in 
this manner. This definition is not too meaningful when the sample mean is zero. 
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Another definition useful in spectrum analysis is in essence a mean squared 
error criterion: 
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which resulted from Winner’s classic work in Harmonic Analysis. 


When used in their proper context, these definitions are closely related and 
can usually be intermixed. Notice that these definitions are power definitions as 
opposed to voltage definitions commonly used in the sciences. To avoid any con- 
fusion, therefore, it is recommended that one use the engineering units of decibel 
when conversing. Thus 


( ^) “10 log^ [power signal -to -noise ratio J 
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and each can use his own numbers and still communicate. 

The next important topic is how the signal -to -noise ratio is related to fidelity. 
Clearly, when speaking of continuous A time functions, the signal -to -noise ratio is 
measuring the deviation of a sample x from the true function x based on a quadrat, 
cost (x A - x)2 referenced to the signal level. In other words, if the signal is 1 then 
1/ (x - x) 2 is related to the number of £-*ay levels we can distinguish. When this 
number is large, the average variation in gray level is small and becomes unnotice 
able. These are the considerations that one takes into account when quantizing a 
signal. Suppose, for example, we wish to quantize a signal. We would like to 
know how the signal -to -noise ratio is related to the number M of distinguishable 
quantization levels. For the sake of argument, suppose that the signal is uni- 
formly distributed between 0 and 1. We divide the interval (0, 1) into M levels. 

If a signal falls anywhere within the interval, we select the center of that interval 
as the sample. At the receiver we always receive the center of the interval inde- 
pendent of where the signal actually was. This introduces what is called quanti- 
zation noise. 

Using the first definition for the signal -to -noise ratio we see that 
[e [z 2 ] -E 2 [z]] y =0 = J 1 ( 1 ) . 
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while the quantization noise o 2 is: 
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Thus: 



is the quantization signal-to -noise ratio. This would be the first step in deter- 
mining how many levels to choose. We can also view this another way. Suppose 
the signal has a bandwidth B requiring a minimum of 2B samples per second. 

Each sample can be quantized into M levels with loggM bits. Therefore, a 
minimum of 2B loggM bits per second is required. 

Assuming we can apply Shannon's capacity formula, we see that the minimum 
signal -to -noise ratio required can be obtained by equating 
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Stated another way, we have 
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resolution for a signal-to-noise ratio S/N. 

The major reason for quantizing signals is that high-speed data processing is 
done in this form. However, it is also true in communications that an advantage 
can be gained using binary (PCM) forms of modulation. To illustrate this point, 
we will compare an amplitude modulation system to the same system quantized. 


Consider a signal X uniformly distributed between 0 and 1 with gaussian noise 
superimposed upon it. This simulates a communications channel. Consider 
Figure 1. 



Figure 1 


Whether the signal is sampled or not, the noise will have the effect of relocating 
the desired level. If we have the requirement of a resolution of 1/M with a 
certain confidence, this means that with probability 



the signal will be in the prescribed interval. Thus 2lo = 1/M, with t specified by 
the percentage of time this will be true. For a 95 percent confidence interval 
(about the minimum for good quality TV), i* = 2. Thus: 
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and, since the signal variance is 1/12: 
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Now if the same signal is quantized into M levels, this requires log.M binary digits. 
In addition, the signal will have to be sampled at least twice per cycle. This means 
that the bandwidth of the binary system will be 2 log ,M times larger than the original 
bandwidth. Thus if we have S/ N for the unquant izea system, we will have a signal - 
to -noise ratio of 
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for the binary system, where Sg is the signal power required for the binary trans 
mission* The relationship between signal -to -noise ratio and bit error p for a 
coherent rf binary system is given in the following table: 
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Thus, for example if p = 10”®, the fractional power required for the binary trans- 
mission is Sg/S, which is equal to 
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Hence, for more than four levels of quantization ( ^ > 12dB ) the binary trans 
mission would .be more efficient. ' 


The final question remaining is: How does the bit error enter into the calcu 
lation of a signal -to -noise ratio? It has been shown that for the uniformly distri- 
buted signal, the noise variance due to bit errors alone is: 




Therefore, if we again choose to reconstruct the signal as the center of the interval 
selected, the total variance of the reconstructed signal after the binary trans- 
mission will be the sum of the quantization variance and the bit error variance or 
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This is plotted in Figure 2. Notice that 
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is the crossover point between being quantization -noise -limited and bit -error 
limited. This point, in fact, would be the most efficient place to fix the design, 
since any increase in signal power would not improve the processed output (quanti- 
zation-noise -limited) whereas a decrease in power would degrade the output below 
the desired level. Attainable outputs lie to the right of the solid line and below the 
dashed line. Notice, for example, that it is incompatible to require an output 
S/N ratio of 40 dB with less than 2^ quantization levels (7 bit word) or more than 
a bit error of 10 (uncoded PCM). One can also see that the major contribution to 
bit error noise is an error in the most significant digit, hence the insensitivity to 
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